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Abstract 

We consider the problem of optimizing signal transmission through multi- 
channel noisy devices. We investigate an array of bithreshold noisy devices 
which are connected in parallel and convergent on a summing center. Utiliz- 
ing the concept of noise-induced linearization we derive an analytical approx- 
imation of the normalized power norm and clarify the relation between the 
optimum threshold and the standard deviation of noises. We show that the 
optimum threshold value is 0.63 times the standard deviation of the noises. 

This relation is applicable to both subthreshold and suprathreshold inputs. 
PACS numbers: 05.40.Ca,02.50.Ey 
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I. INTRODUCTION 



Stochastic resonance (SR) has attracted considerable attention of many researchers dur- 
ing the last quarter century [1-7]. At first SR was proposed to explain the observed peri- 
odicities in global climate dynamics [1]. SR occurs when the signal-to-noise ratio (SNR) for 
the response of a single nonlinear system to a subthreshold sinusoidal input signal has its 
maximum at a nonzero noise strength D. As well-known, the SR effect is understood as 
enhancement of the system input to a subthreshold input signal by addition of noise. 

There are many studies on SR for a single element. For example Gammaitoni et al. 
showed with SNR that a subthreshold sinusoidal signal to a single threshold element is 
optimally transduced by appropriate additive noise [8]. Collins et al. also reported that a 
single neuron can optimally transmit a slowly varying subthreshold aperiodic signal with the 
aid of appropriate additive noise [9] . They proposed the power norm Cq and the normalized 
power norm C\ in order to measure a correlation between the input signal and the output 
signal and showed that both Co and C\ monmonotonically vary with increasing the noise 
strength. It is known as aperiodic stochastic resonance (ASR). 

Many researchers have both experimentally and numerically studied the symmetrical 
stochastic resonator such as the Schmitt trigger [10-13]. In recent years, the central attention 
of SR seems to move to a network of the stochastic resonators, instead of a single stochastic 
resonator, such as the global coupled networks and linear chains [14,15]. In more recent 
years a parallel array of nonlinear elements gathers a lot of attention, where the parallel 
array means that the nonlinear elements are connected in parallel and convergent on a 
summing center [6,16,17]. 

Recently Stocks studied the parallel array of the nonlinear devices and reported that 
the suprathreshold stochastic resonance (SSR) can be observed on these array motivated by 
applications to signal processing [6]. Also from the standpoint of neurophysiology Collins et 
al. and Chialvo et al. studied an parallel array of noisy neurons can exhibit ASR for slowly 
varying signal [16,17]. Consequently it is important to consider the parallel array in both 
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signal processing and neurophysiology. 

The main focus of the article is to find an optimal threshold to transmit an arbitrary 
signal on the parallel array of the bithreshold elements. According to the assumption that the 
amplitude of the input signal is smaller than the standard deviation of the noises we derive 
an analytical approximation of the normalized power norm. Under this assumption it is not 
necessary to distinguish between subthreshold and suprathreshold. Furthermore we apply 
the linear response theory to the system that we consider in the article. The fundamental 
idea is the noise-induced linearization, which is an effect that an ensemble average of output 
from a nonlinear system is linearized due to noise [19]. From the theoretical approximation 
of the normalized power norm we show that there exists the optimal threshold to maximize 
it. 

In fact Stocks and Mannella numerically showed that for a summing network of FitzHugh- 
Nagumo equations adjusting the threshold to maximize information transmission does not 
remove SR effects. They pointed out that there is a optimal threshold to maximize the 
mutual information [18]. Our result is consistent with their indication. 

The article is organized as follows. In Sec. II we show the array of bithreshold units. It 
is well-known that Schmitt trigger is a prototype of bithreshold devices [10]. In Sec. Ill we 
theoretically derive an approximation of the normalized power norm under the assumption 
that the norm of the input signal is smaller than the additive noise. Utilizing the approx- 
imation we find an optimal threshold where the normalized power norm is maximized. In 
Sec. IV we perform numerical simulations for the model and show that the threshold value 
at the maximum normalized power norm depends on the variance of the additive noises. 
Sec. V is devoted to concluding remarks. 

II. MODEL 

Figure 1 displays noisy bithreshold elements connected in parallel and convergent on 
a summing center. s(tj), which is sampled with a sampling period T, namely, tj = jT 
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(j = 0,1,2,...), represents a weak aperiodic signal fluctuating around with Xi(tj) and 
Ui(tj) denoting the input to and output from the ith subsystem, respectively. The input to 
the bithreshold element is transmitted over noisy channel. Hence the input to the subsystem 
is expressed as 

x i (t j ) = s(t j )+£ i (t j ), (1) 
where d(tj) (j = 0, 1, 2, . . .) is independently sampled from the Gaussian distribution, 



where A > are the variance of Each bithreshold element is symmetric and has 

three output values. It is formalized by 



Vi(tj) = < 



1 ( Xi (tj) > A,) 

(-K < Xi(tj) < A,) , (3) 
-1 (xi(tj) < -Ai) 



where Aj > are threshold values. 

The system output through the summing center Y^itj) is defined as, 



1 N 

W=vE^i). ( 4 ) 

JV 1=1 

where is the number of the subsystems. Without noises, each input Xi(tj) cannot cross the 
threshold value, leading to the system output Y^itj) = 0. With noises having an appropriate 
variance, Xi(tj) can cross the threshold value. 

III. THEORETICAL ANALYSIS 

We consider the ith bithreshold subsystem. Let P+(tj), P-(tj) and Po(tj) be probabil- 
ities that yi(tj) takes 1, —1 and 0, respectively. For an arbitrary input signal s(tj) these 
probabilities are given by, 
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P. (ti) = ie rf c(^fl), (a) 
P (t j ) = l-P+(t j )-P4t j ), (7) 

where erfc(x) is the complementary error function, which is defined as, 

erfc(x) = -= / e~ u du. (8) 
^Jix Jx 

For simplicity we set A, = A and Di = D for all the subsystems. From Eqs. (5), (6) and 
(7) we introduce A = ^= and ((tj) — -^jj- The input signal is subthreshold when ((tj) < A 
and suprathreshold when ((tj) > A. 

From Eqs. (4), (5), (6) and (7) the ensemble average of Y N (tj) is calculated as 

<Y„fe)> = l -{erk(^M) - erfc(^J^)}. (9) 

Taylor expansion of Eq. (9) around ((tj) = yields 

(Y N (tj))^G(\)((tj) + 0(((tjf), (10) 

where G(X) represents the first order coefficient, which is given by 

G(\) = ^(Y N (tj))\ atj)=0 = ^e->r. (11) 

Thus Eq. (10) shows that (Y N (tj)) is a linear function of the input signal ((tj) for (\(\) <C 1, 
where (\(\) is the norm of the input signal, measured by the average of the amplitude of the 
signal. We call G(X) in Eq. (10) "gain". 

Now in order to measure correlation between the input signal s(tj) and the output signal 
Y;sr(tj) we introduce the normalized power norm [9] 

Ci = ; °° (12) 

where C n is defined as 



C = s(tj)Y N (tj), (13) 



with the overbar denoting an average over time, 



j M 



s{t 3 )Y N {t 3 ) = Jim^ — £ s^Y^tj). (14) 

Maximizing Ci corresponds to maximizing the coherence between s(tj) and Y N (tj), namely, 
it is equivalent to maximizing information transmission through the devices in Fig. 1. 

At first we discuss the numerator of Eq. (12). For large N Y N (tj) asymptotically tends 
to (Y]sr(tj)) according to the law of large number. From Eq. (10) the power norm Co is 
calculated as, 



where |]s|| is define as \J s(tj) 2 , namely, the power norm is proportional to the gain G(X) for 
a given input signal. 

Next we consider the denominator of Eq. (12). For the purpose we introduce rj(tj) = 
(Y N (tj)) — Y N (tj) we have (rj(tj)) = and 

A? = (V'itj)) = = ([Y N ( tj ) - (YsM)] 2 ) 
= (Y^tj)) - (Y N (tj)} 2 

= jf{P+(ti) + P-(tj) ~ (P + (t 3 )-P-(t 3 )f}. (16) 

Y]\r(tj) is distributed around the ensemble average (Yjv(ij)), and \J~A~j is of order of iV -1 / 2 . 
Substituting Eqs. (5), (6) and (7) into Eq. (16) yields 

A,(iV,A) 

4{^^>+e*(^>) 

-i(e rf c(^) -e*(^>>n. , 17 , 

Expanding the variance Aj around ((tj) = we have 

A, (TV, A) 

= ^{erfc(A) - Iexp(-A 2 )C(t,) 2 } + 0(C(t,) 4 ). (18) 



The first term of Eq. (18) results from a fluctuation of the output signal Y N (tj) without the 
input signal. 



Now we consider (Yjsr(tj) — Y/v(i,)) 2 , calculated as follows [17]. We have 



(Y N (tj) — Y N (tj)) 2 = Y N (tj) 2 Y N (tj) . Since we consider a zero-mean input signal Y N (tj) = 0. 
From Y N (tj) = (Y N (tj)) + r)(tj) we have 



Y N {t 3 ) 2 = (Y^t,)) 2 + 2(Y N (t j ))r ] (t j ) + V {t 3 f 



= (Y N (t J )) 2 + A J , (19) 

where we use {YN{tj))rj(tj) = 0, which is proven by employing an ergodic assumption. Hence 
from Eqs. (13) and (19) C 1 is expressed by 

c GW\\s\\ 2 



NIV^(<^)> 2 + A,) 
1 



1+ A ^ 



«v(t,)> 2 

1 



where C\ denotes the ratio between (Y N (tj)) 2 and the variance A^: 



(20) 



c: = (2!) 

This statistical measure, which is dimensionless and independent of scale, is the squared 
reciprocal of the coefficient of variation. High c\ indicates low variability of the output 
signal. If (Y N (tj)) is approximated by the first term of Eq. (10), and Aj the first term of 
Eq. (18), we obtain 

ci .w^) ,| C ||. (22) 

where \ \(\ \ = \\s\\/VD. From Eq. (20) it is clear that C\ is maximized when c\ is maximize. 
Moreover from Eq. (22) it is easily confirmed that C\ is maximized at A ^ 0.63, so that 0.63 
is the optimal threshold. 



In order to infer the input signal s(tj) from the output signal Yjsritj) it is necessary that 
(Y N (tj)) is sufficiently larger than the fluctuation of Y N (tj). If we impose the condition 
Ci > 1, i.e., C\ > l/y/2 we have 

IK">^f fc (^MT)- (23) 

This inequality assures that we can infer the input signal s(tj) from — ^^y^ for C\ > ly/2. 

IV. NUMERICAL SIMULATIONS 

Figure 2 displays the normalized power norm C\ drawn as a function of A at fixed ||£|| 
from direct numerical simulations of the array of the bithreshold elements at N = 100. 
The input signal is given by s(tj) = 0.5 Asin(27r ft j) + Acos(Anftj) + 0.25 Asin(87r ft j) at 
/ = 10.0 and T = 0.001, where ||C|| is given by ^J^A/^/D. The points are obtained from 
the numerical simulations for various A at ||£|| = 1, 0.1 and 0.01, respectively. The curves 
represent Eq. (20) at the same parameters as the numerical simulations. It is found that the 
results from the numerical simulations is well fitted by the theoretical relation for | \(\ | = 0.1 
and 0.01. C\ has it maximum at A = 0.63. 

However for ||£|| = 1 it differs from the theoretical equation. The reason is because the 
output signal Y^itj) is not well approximated by the linear response of the input signal s(tj) 
due to the limit of applying the linear response theory. This disagreement is originated from 
difference between the nonlinear response of the system and the linear response assumed in 
Sec. III. 

We demonstrate the output signal Y N (tj) for various A = 0.63, 1.5 and 3.0 as shown 
in Fig. 3. The output signal Y^(tj) is similar to the input signal s(tj) in the order for A 
shown. In this demonstration the input signal is given by a periodic signal. Naturally the 
theoretical equation of C\ which we obtained is applicable to any input signal (of course an 
aperiodic signal) satisfied with ||£|| < 1. Specifically when the input signal is satisfied with 
Eq. (23) the output signal gives a good approximation of the input signal at A = 0.63. 
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V. CONCLUSION 



We have investigated the parallel array of bithreshold elements both theoretically and 
numerically We give an analytical approximation of the normalized power norm C\ under 
the assumption that the norm of the input signal s(tj) is smaller than the standard deviation 
of the additive noises without distinguishing between subthreshold input and suprathreshold 
input. We confirmed that the theoretical approximation of C\ is consistent with the results 
obtained from the direct numerical simulations of the array of the bithreshold elements 
when the norm of the input signal is smaller than the standard deviation of the additive 
noises. While for the larger norm than the standard deviation the difference between the 
approximation and the numerical results appears. This disagreement is originated from the 
nonlinear response of the system. We demonstrated that the output signal gives a good 
approximation of the input signal at an appropriate threshold. We clarify that the optimal 
threshold, where the normalized power norm has a maximum value, is given by 0.63 times 
the standard deviation of the noises. 

Our study may be applied to a sophisticated array of amplifiers. Moreover the result 
shows that a collection of simple bithreshold sensors can detect a weak signal under an 
independently noisy environment. 



9 



REFERENCES 

[1] R. Benzi, S. Sutera, and A. Vulpiani, J. Phys. A 14, L453 (1981). 
[2] B. McNamara and K. Wiesenfeld, Phys. Rev. A 39, 4854 (1989). 

[3] K. Wiesenfeld, D. Pierson, E. Pantazelou, C. Dames and F. Moss, Phys. Rev. Lett. 72, 
2125 (1994). 

[4] C. Eichwald and J. Walleczek, Phys. Rev. E 55, 6315 (1997). 

[5] L. Gammaitoni, P. Hanggi, P. Jung and F. Marchesoni, Rev. Mod. Phys. 70 223 (1998) 

[6] N.G. Stocks, Phys. Rev. Lett. 84, 2310 (2000); Phys. Rev. E 63, 041114 (2001); Phys. 
Lett. A 279, 308 (2001). 

[7] F. Duan and B. Xu, Int. J. Bifurc. Chaos 13, 411 (2003). 

[8] L. Gammaitoni, F. Marchesoni, E. Menichella-Saetta and S. Santucci, Phys. Rev. Lett. 
62, 349 (1989); L. Gammaitoni, Phys. Rev. E 52, 4691 (1995). 

[9] J.J. Collins, C.C. Chow and T.T. Imhoff, Phys. Rev. E 52, 3321 (1995). 

[10] F. Marchesoni, F. Apostolico, L. Gammaitoni and S. Santucci, Phys. Rev. E 58, 7079 
(1998). 

[11] A.C.H Rowe and P. Etchegoin, Phys. Rev. E 64, 031106 (2001). 

[12] F. Apostolico, L. Gammaitoni, F. Marchesoni and S. Santucci, Phys. Rev. E 55, 36 
(1997) 

[13] M. Litong, Y. Hayakawa and Y. Sawada, Phys. Rev. E 64 026117 (2001). 

[14] F. Marchesoni, L. Gammaitoni and A.R. Bulsara, Phys. Rev. Lett. 76, 2609 (1996). 

[15] J.F. Lindner, B.J. Breen, M.E. Wills, A.R. Bulsara and W.L. Ditto, Phys. Rev. E 63, 
051107 (2001). 



10 



[16] J.J. Collins, C.C. Chow and T.T Imhoff, Nature 376, 236 (1995). 

[17] D.R. Chialvo, A. Longtin and J. Muller-Gerking, Phys. Rev. E 55, 1798 (1997). 

[18] N.G. Stocks and R. Mannella, Phys. Rev. E 64, 030902 (2001). 

[19] M.I. Dykman, D.G. Luchinsky, R. Mannella, P.V.E. McClintock, H.E. Short, N.D. Stein 
and N.G. Stocks, Phys. Lett. A 193, 61 (1994). 



11 



FIGURES 
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FIG. 1. The array of bithreshold elements with a summing center. s(tj) exhibits the input of 
the system. Each subsystem is a bithreshold element, which has three output values. Xi(tj), yi(tj) 
and Aj represent the input, the output and the threshold value in the iih subsystem, respectively. 
All the output of subsystems are summed by the summing center and divided by N. Y/v(t/) shows 
the system output. 
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FIG. 2. The normalized power norm C±, drawn as a function of the threshold value A at 
N = 100 and a fixed amplitude of the input signal. We performed numerical simulations using 
the input signal given by s(tj) = 0.5-Asin(27r/ij) + A cos(4:ir ft j) + 0.25^4 sm(8ir ft j) at / = 1.0 and 
T = 0.001. Then we have M = ||C|| = yf^A/y/D. We calculate d for various A at ||C|| = 1, 0.1 
and 0.01. A solid curve represents the theoretical relation, Eq. (20) at ||C|| = 1, a dashed curve 
at D = 0.1, a dotted curve at 0.1 and a dashed curve at 0.01. Filled squares are results of the 
numerical simulations at ||£|| = 1, unfilled circles at 0.1, and filled circles at 0.01. It is found that 
for ||£|| = 0.1 and 0.01 the value of A maximizing C\ is 0.63. 



13 



0.02 
0.015 
0.01 
oT 0.005 
3 
g- -0.005 
-0.01 
-0.015 
-0.02 




(a) 



1 1.2 1.4 1.6 1.8 2 

t 



(b) 



0.3 

e 0.2 

>? 0.1 
3 
3- -0.1 
o -0.2 
-0.3 



output 



1 1.2 1.4 1.6 1.8 2 



3- -0. 



OUtf 


ut 


1 1.2 1.4 

t 


1.6 1.8 2 


output — 





1 1.2 1.4 1.6 1.8 

t 



(c) . (d) 

FIG. 3. Time series of the input signal s(tj), of which the waveform is the same as Fig. 2 (a). 

We performed the numerical simulation at N = 100, D = 0.1 and ||C|| = 0.1. The output signal 

Y N (tj) at A = 0.63 (d = 0.669) (b), at A = 1.5 (d = 0.577) (c) and A = 3.0 (C\ = 0.166) (d). 
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